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SIMULTANEOUS DIAGONALIZATION OF MATRICES AND ITS 
APPLICATIONS IN QUADRATICALLY CONSTRAINED 
QUADRATIC PROGRAMMING* 

RUJUN JIANG* AND DUAN LI* 


Abstract. An equivalence between attainability of simultaneous diagonalization (SD) and hid¬ 
den convexity in quadratically constrained quadratic programming (QCQP) stimulates us to inves¬ 
tigate necessary and sufficient SD conditions, which is one of the open problems posted by Hiriart- 
Urruty [SIAM Rev., 49 (2007), pp. 255—273] nine years ago. In this paper we give a necessary and 
sufficient SD condition for any two real symmetric matrices and offer a necessary and sufficient SD 
condition for any finite collection of real symmetric matrices under the existence assumption of a 
semi-definite matrix pencil. Moreover, we apply our SD conditions to QCQP, especially with one or 
two quadratic constraints, to verify the exactness of its second-order cone programming relaxation 
and to facilitate the solution process of QCQP. 

Key words, simultaneous diagonalization, congruence, quadratically constrained quadratic 
programming, second-order cone programming relaxation. 
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1. Introduction. Recently, Ben-Tal and Hertog [2] show that if the two ma¬ 
trices in the objective function and the constraint of a quadratically constrained 
quadratic programming (QCQP) problem are simultaneously diagonalizable (SD), 
this QCQP problem can be then turned into an equivalent second-order cone pro¬ 
gramming (SOCP) problem, which can be solved much faster than the semi-definite 
programming (SDP) reformulation. (Note that to simply the notation, we use the 
abbreviation SD to denote both “simultaneously diagonalizable” and “simultaneous 
diagonalization” via congruence when no confusion will arise.) A natural question to 
ask is when a given pair of matrices are SD. Essentially, the SD problem of a finite 
collection of symmetric matrices via congruence is one of the 14 open problems posted 
by Hiriart-Urruty [6] nine years ago: “A collection of m symmetric (n, n) matrices 
{Ai,A 2 , ..., A m } is said to be simultaneously diagonalizable via congruence if there 
exists a nonsingular matrix P such that each of the P T AiP is diagonal.” 

Two sufficient conditions for SD of two matrices A and B have been developed in 
[6, 13, 14, 17]: i) There exist and £ 5ft such that ^i\A + ^l 2 B >- 0, which is termed 
as regular case in [13, 14, 17]; and ii) When n > 3, ((Ax,x) = 0 and ( Bx,x} = 0) 
implies (x = 0). Lancaster and Rodman [10] offer another sufficient condition for SD 
of two matrices A and B: There exist a and f3 such that C := a A + j3B P 0 and 
Ker(C) C Ker(A) (~l Ker(B). Several other SD sufficient conditions of two matrices 
are presented in Theorem 4.5.15 of [7]. A necessary and sufficient condition for SD of 
two matrices has been derived by Uhlig in [20, 21] if at least one of the two matrices 
is nonsingular. A sufficient SD condition is well known for multiple matrices: If m 
matrices commute with each other, then they are SD, see [7] (Problems 22 and 23, 
Page 243). The equivalence between the attainability of SD and a hidden convexity 
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in QCQP stimulates the research in this paper. 

In this paper, we provide a necessary and sufficient SD condition for any two real 
symmetric matrices, which extends the result in [21] to any two arbitrary matrices. We 
then show its applications in QCQP with one quadratic inequality constraint or with 
an interval constraint. Furthermore, we find a necessary and sufficient SD condition 
for m (m > 3) real symmetric matrices when there is a semi-definite matrix pencil, i.e., 

there exist Ai,..., X m £ (not all of which are zero), such that XiAi + X 2 A 2 H-b 

A mA m 0. The semi-definite matrix pencil has been a widely adopted assumption in 
the solvability study in SDP and its duality [9, 18]. We also show its applications in 
QCQP and show that QCQP with two quadratic constraints has a non-trivial exact 
relaxation. Our proofs are constructive for both cases of two matrices and multiple 
(more than two) matrices. Thus, we essentially establish systematic procedures for 
testing SD using the derived sufficient and necessary condition for any finite number 
of symmetric matrices. 

Our paper is organized as follows. In Section 2, we provide a necessary and suffi¬ 
cient SD condition for any pair of real symmetric matrices and show its applications 
in QCQP with one quadratic inequality constraint or an interval quadratic constraint. 
In Section 3, we show necessary and sufficient SD conditions for a finite number of 
real symmetric matrices under the definite matrix pencil condition and a more gen¬ 
eral semi-definite matrix pencil condition. We next discuss the applications of SD in 
QCQP with multiple, in particularly 2, quadratic constraints in Section 4. Finally, 
we conclude our paper in Section 5. 

Notation. We use I p and 0 p to denote the identity matrix of dimension p x p 
and the zero square matrix of dimension p x p, respectively, and use 0 px <j to denote a 
zero matrix of dimension p x q. The notation represents the n dimensional vector 
space and S n represents the n x n symmetric matrix space. We denote by tr(A) the 
trace of a square matrix A, and diag(Ali, A 2 , ..., A k ) the block diagonal matrix 

(M \ 

^2 

. ? 

V A k ) 

where A il i = 1,..., k, are all square matrices. Finally, we use Diag(X) to denote 
the vector formed by the diagonal elements of the square matrix X with Diag(X)fc 
representing its fcth entry. 

2. Simultaneous diagonalization for two matrices. In this section, we first 
derive a necessary and sufficient simultaneous condition for any two matrices and then 
show its applications in the trust region subproblem (TRS) and its variants. 

2.1. SD condition. The following lemma from [21] shows a necessary and suffi¬ 
cient condition for SD of two matrices if at least one of the two matrices is nonsingular. 

Lemma 2.1. [21] If one of the two real symmetric matrices A and B is nonsin¬ 
gular (without loss of generality, we assume that A is nonsingular), they are SD if 
and only if the Jordan normal form of A~ l B is diagonal. 

The following lemma is also useful in deriving the congruent matrix to achieve 
the SD for two matrices. 

Lemma 2.2. (Lemma 1 in [20]) Let a Jordan matrix he denoted by 
K:= diag(C(A 1 ), C(A 2 ),..., C(Afc)), 
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where C{\i) := (Aj), K i2 (A^ ),..., (Aj)) denotes all the Jordan blocks as¬ 

sociated with eigenvalue Aj, and 


( K l 

A,; 1 


K,. := 


Aj 1 

Aj / 


j = 1,2,...,t. 

If SK is symmetric for a symmetric matrix S, then S is block diagonal, S = 
diag(5'i, S 2 , • • • j Sk), with dim £) = dim C(Aj). 

When the condition in Lemma 2.1 is satisfied, we can identify a congruent matrix 
that makes two n x n symmetric matrices A and B SD as follows. 

When A is nonsingular and the Jordan normal form, denoted by J , of A _1 U is 
diagonal, there exists a nonsingular matrix P such that 

J := P~ 1 A~ 1 BP = diag(Ai/ ni ,..., A*,/„„), 

where k < n. Noting the facts that P T AP is symmetric and ( P T AP)J = P T BP is 
symmetric. Applying Lemma 2.2, we have the following two block diagonal matrices, 

P t AP = diag(Ai,..., A k ) and P T BP = diag(Bi,..., B k ), 


where diag(Ai,..., A k ) and diag(i?i,..., B k ) have the same partition as J, i.e., dim Aj = 
dim 13 j = dim/ ni , i = 1,..., k. Moreover, 

J = P~ 1 A~ 1 BP = ( P t AP)~ 1 P t BP 
= (diag(Ai,..., A k ))~ l diag(Bi,. ..,B k ) 

= diag (Af 1 B 1 ,... ,Af 1 B k ). 

Thus, for i = 1,..., k, A~ 1 B i = XiJ ni , i.e., AjAj = B t . Let R = diag(i?i,..., R k ) such 
that Rf AiRi is a spectral decomposition of Aj, and then i?.fBji?j = \RjAiR t is also 
diagonal, i = 1,..., k. So with the two nonsingular matrices P and R, (PR) T APR 
and (PR) t BPR are both diagonal, i.e., A and B are SD via the congruent matrix 
PR. 

Lemma 2.3. Let A := diag(Ai, 0 9 + r ) and 

/ B\ 0 pX q B 2 \ 

B := I 0 qxp 0 qxr J j 

\ Bj 0 rxq 0 r J 

where both A\ and B\ are p x p nonsingular real symmetric matrices, B 3 is a q x q 
nonsingular real symmetric matrix, and B 2 is a p x r matrix with r < p and with full 
column rank, then A and B cannot be SD. 

Proof. We will prove the lemma by contradiction. Let us assume that A and B 
are SD. Then, there exists a congruent matrix 


( Pi I f I f 
Pa If If 
V If If If 


P := 
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where the partition of P is the same as the partition of B , such that P T AP and 
P T BP are diagonal, and without loss of generality, the nonzero elements of P T AP 
lie in the first p entries of the diagonal 


/ Pi A-iPj Pi A X P 2 PlA x P 3 \ 
P T AP = P?A X P X P£A x P 2 P 2 A x P 3 

\ P?A 1 P 1 P% A x P 2 Pi A x P 3 J 


Since A x and PjA x P\ are nonsingular and P x is nonsingular, and thus P x A\ is 
nonsingular. As P T AP is diagonal, then Pi A 4 P 2 and Pj 2 "A 1 P 3 are both zero matrices. 
Thus, P 2 = 0 and P 3 = 0. 

Furthermore, the following transformation holds for matrix B 1 


( P x B X P X + P x B 2 Pj 
+P4 B3P4 + P?BTp x 
P 8 t P 2 t P 1 + P 5 t P 3 t P 4 

V P9P2 Pi + Pj B 3 P4 


pf B 2 p 8 + PjB 3 P 5 Pf P2P9 + PiB 3 P 6 N 

P 5 t P 3 P 5 P 5 t P 3 P 6 

pI bJ P 5 PlB 3 p 6 


From our assumptions, B x and B 3 are both nonsingular, and B 2 is of full column 
rank, which implies that B is nonsingular. So the diagonal matrix P T BP must be 
nonsingular. As PiB 3 P 5 is nonsingular, P 5 is thus nonsingular. Note that PiB 3 P e = 
0 implies that Pq = 0 9X r, which further leads to PiB 3 Pq = 0 r . This contradicts the 
non-singularity of P T BP. □ 

Lemma 2.4. For any two p x p real symmetric matrices A\ and B 1 , and a q x q 
matrix B 2 , if A\ and B 2 are nonsingular and diagonal, and B\ is nonsingular, then 
A x and B x are SD if and only if A := diag(Ai,0 g ) and B := diag(Pi, B 2 ) are SD. 

Proof. The “=>” part: If A 4 and B x are SD via congruent matrix S pxp , then the 
congruent matrix di&g(S pxp , I q ) makes A and B SD. 

The “<=” part: If A and B are SD, then there exists a nonsingular matrix 


P := 


Pi P 2 \ 
P 3 P 4 ) ’ 


such that, i) matrix 


p t ap = 



A\ 


% 


Pi P'2 
P 3 P4 


PiA l P 1 PlA x P 2 \ 
P 2 A\P\ P 2 t AiP 2 ) 


is diagonal, where, without loss of generality, the diagonal matrix PiA X P X is assumed 
to be nonsingular, and ii) matrix P T BP is diagonal. Then, P\ must be nonsingular 
and P 2 must be a zero matrix. We can now simplify P T BP to 

( Pi Pi \( B x \( Pi 0 pxq \ f PiB\P\ + PlB 2 P 3 Pi b 2 p 4 \ 

'v o 9 xp Pi J v B 2 )\p 3 P4 ) \ PlB 2 p 3 p!b 2 p 4 j ■ 


Since both B 2 and PiB 2 P 4 are nonsingular, P 4 is nonsingular. Thus, P 3 = 0, due to 
Pi B 2 P 4 = 0. Finally, we conclude that Pi Pi Pl is diagonal. 0 

Lemma 2.5. For any two n x n singular real symmetric matrices A and B, there 
always exists a nonsingular matrix U such that 


A x 

Q(n—p) xp 


0 


px(n-p) 

@n—p 


( 2 . 1 ) 


A := U t AU = 
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and 

( Bx Opxq B 2 \ 

(2.2) B := U t BU = 0, xp B 3 O qxr , 

\ B% OrXq O r J 

where p, q, r > 0, p + q + r = n, A\ is a nonsingular diagonal matrix, A\ and B\ have 
the same dimension of p x p, B 2 is a p x r matrix, and B 3 is a q x q nonsingular 
diagonal matrix. 

Proof. We outline a proof for this lemma. Applying the spectral decomposition 
to A identifies matrix Q\ such that A := QjAQx = diag(Ai, 0 ra _ p ), where A\ is a 
p x p nonsingular diagonal matrix. We express the corresponding QjBQx as 

S:=<?rflQ. = (j| % 

where B \ is of dimension p x p. 

If B 3 is not diagonal, we can further apply the spectral decomposition to B 3 by 
identifying a congruent matrix Q 2 := diag(/ p , Vx) such that Vl B 3 V\ is diagonal and 
the nonzero eigenvalues of B 3 V\ are arranged to the upper left part of its diagonal. 
Then A := Q\AQ 2 = A and 


- 1 

( Bx 

b 4 

Be 

b-qIbq 2 = 

Bl 

B e 

^qx(n—p—q) 

\ 

K Bl 

0( n—p—q ) X q 

0 n—p—q 


where Bq is a nonsingular diagonal matrix of dimension q x q. 
Applying the congruent matrix 


0 


Q 3 ; — 


-B^Bl 


'pxq 

I 


o. 


px(n—p—q) 


q Qqx(n-p-q) 


^(n—p—q)xp ^(n—p—q)xq 

to both A and B yields A := AQ 3 = A = A and 

0 . 


d-n—p—q 


B\ — /i,l /if; 1 /I 


B :=Ql BQ 3 = 


0 , 


qxp 

Bl 


‘pxq 

0 qx^n—p—q) 

0( n—p—q)xq 0 n—p—q 


which take exactly the forms in (2.1) and (2.2), respectively. 

In summary, letting U := Q\Q 2 Q 3 yields the forms of U T AU and U T BU given 
in (2.1) and (2.2) in the lemma, respectively. □ 

We present next a theorem which extends the results in [21] to situations where 
both matrices are singular. 

Theorem 2.6. Two singular matrices A and B, which take the forms (2.1) and 
(2.2), respectively, are SD if and only if the Jordan normal form ofAf 1 Bi is diagonal 
and B 2 is a zero matrix or r = 0 (B 2 does not exist). 

Proof. Recall that A and B are SD if and only if A and B are SD (The notations 
A and B are the same as those in Lemma 2.5.). We can always choose a sufficiently 
large A such that the first p columns of B + XA are linearly independent. For example, 
by setting A = maxi = i i ... iP l^ij|/l a ii| + 1) where an is the ith diagonal entry of 

the nonsingular diagonal matrix A\ and bij is the (i, j)th entry of B\ and noting that 
A\ is diagonal, AAi + B\ becomes diagonally dominant and is thus nonsingular. 
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If £> 2 does not exist or is a zero matrix, A and B are SD <t=> B + XA and A are 
SD (A > 0) A A 1 + Bi and Ai are SD <t=> £>1 and A\ are SD <t=> the Jordan normal 
form of A^Bi is diagonal, where the second “-o-” follows Lemma 2.4. 

If the columns of B 2 are linearly independent, according to Lemma 2.3, A and 
A A + B are not SD => A and B are not SD =>■ A and B are not SD. 

If the columns of £>2 are linearly dependent, we can find a nonsingular congruent 
matrix 


Qa ■= 


± p 

Ogxp 

0(n— p— q) Xp 


such that A := Q 4 AQ 4 = A and 


/ 


B := QjBQ 4 = 


Br 

0 qxp 

BJ 


Qpxq 

d(n— p— q) X q 


u PXq 

Bo 


J sXq 


Qpx(n—p—q) 

0 qx(n—p—q ) 
T(n—p—q) x ( n—p—q ) 


£4 

Oq'Xs 

0 , 


l—p—q—s) \ 


\ d(n— p— q—s)xp ^(n—p—q—s) X q n—p—q—s)xs 


px(- 

] qx(n—p—q—s ) 
X ( n—p—q—s ) 
On— p—q—s 


where T( n _ p _ 9 ) X ( n _ p _ g ) is the product of elementary matrices which makes 


^2^D(n— p— q) X (n—p—q) — (^4?0); 


and £>4 is a p x s (s < n — p — q) matrix with full column rank. Then according to 
Lemma 2.3, similar to the case where £>2 is of full column rank, A and B are not SD. 

We complete the proof of the theorem. □ 

Algorithm 1 provides us an algorithmic procedure to verify whether two matrices 
A and B are SD. 

We next demonstrate the computational procedure to find the congruent matrix in 
checking whether a pair of matrices are SD via an illustrative example. The notations 
in the example follow the ones in Algorithm 1 . 

Example 1 


JL 

0 

u 

4 

u 

0 

u 

0 

u 

0 

0 


' ± 

2 

5 

u 

1 

u 

0 

O 

0 

0 

0 

0 

9 

0 

0 

0 

and B := 

0 

1 

7 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

2 

2 

0 

0 

0 

0 

0 

0 

0 


3 

0 

0 

2 

5 

0 

V 0 

0 

0 

0 

0 

0 ) 


l 0 

0 

0 

0 

0 

0 ) 


Let A := 


the following congruent matrix which is derived in the appendix, 


Applying 


( 

3.98 

194.23 

- 0.21 

0 

0 

0 \ 


7.09 

-27.55 

-0.29 

0 

0 

0 


1 

1 

1 

0 

0 

0 


3.98 

194.22 

- 0.21 

-0.45 

-0.89 

0 


-3.98 

-194.22 

0.21 

-0.89 

0.45 

0 

V 

0 

0 

0 

0 

0 

1 / 


we obtain two diagonal matrices, 


P t AP = diag(226,40772,9,0,0,0), 


and 


P t BP = diag(354, -93111,7,6,1,0). 










RUJUN JIANG AND DUAN LI 


7 


Algorithm 1 Procedure to check whether two matrices A and B are SD 
Input: Two symmetric n x n matrices A and B. 
l: Apply the spectral decomposition to A such that A := QjAQi = diag(Ai,0), 
where A\ is a nonsingular diagonal matrix, and express B := Qf BQ\ = 
B\ B 2 




B, 


2 : Apply the spectral decomposition to B 3 such that B 3 \\ = 


B 6 0 

0 0 


and 


/ 0 
0 V? 


Q\BQ l 



, where Be is a nonsingu¬ 


lar diagonal matrix and (B 4 B 5 ) = B 2 V \; Denote Q 2 := diag(J, Pi) 

Bi B4 Be 

3: Set A = Q 2 AQ 2 = A and B := Q 2 BQ 2 = 


Bj 


if Be exists and Be A 0 then 
return “not SD” 
else 

I P 

Denote Q 3 := | — B 6 1 Bj 


B T e 


Be 

0 


Jpxq 


Further denote A := QjAQ 3 = 


In—p—q 


Bi - //, B f . 1 B 


A = A 1 B := QjBQ 3 = 


0 

Be 


8 : if the Jordan normal form of A x 1 (i?i — B^B^ 1 Bj) is a diagonal matrix, i.e., 

V 2 ~ 1 A^ 1 (B 1 - B^Bg 1 Bj)V 2 = diag(A 1 /„ 1 ,..., Awhere V 2 is nonsingular 


then 

9: Find Rk, k = 1, which is a spectral decomposition matrix of the 

fcth diagonal block of V 2 A\V 2 \ Denote R := diag(i?i,..., i? t ), Q 4 := 
diag(l/ 2 R,I q +r) and P := Q 1 Q 2 Q 3 Q 4 

10: return diagonal matrices QjAQ 4 and Q^BQ 4 and congruent matrix P 

ll: else 

12 : return “not SD” 

13: end if 

14: end if 


Remark 2.1. Computational methods for obtaining the Jordan normal form that 
are of complexity 0(n 3 ) can be found in [1] and [5]. One computational problem in 
computing the SD form for two matrices is the unstability of the numerical methods 
for Jordan normal form, see Chapter 7 in [f], [5] and [ 8 ]. ^4s a small perturbation in 
a problem setting may cause significant change in the formation of the Jordan blocks, 
it becomes difficult to deal with large-scale problems, see [1], Our situation, however, 
is special, as we only need to calculate the Jordan normal form for real eigenvalues 
and we stop when the block size of any Jordan block is larger than 1 (implying that the 
two matrices are not SD). On the other hand, several symbolic computational methods 
have been developed to calculate the exact Jordan normal form (Please refer to [11] 
and [16]). 
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2.2. Applications to the generalized trust region subproblem and its 
variants. Recall that the TRS is a special QCQP problem with one quadratic con¬ 
straint: 


(TRS) min ^ x T Bx + ci T x 
s.t. ||x|| 2 < 1, 

where B is an n x n symmetric matrix and a £ JR n . Numerous solution methods for 
problem formulation (TRS) have been developed in the literature, see for example, 
[12] and [15], 

We consider the following extension of (TRS), which is called the generalized trust 
region subproblem (GTRS) in the literature: 

(GTRS) min —x T Bx + a T x 

s.t. ^ x T Ax + c T x + irf < 0, 

where A and B £ S n are n x n symmetric matrices, and a,c,x £ 5ft" and d £ 5ft. 
Sturm and Zhang [19] prove the equivalence between the primal problem and its SDP 
relaxation for the GTRS. However, the state-of-the-art of SDP solvers do not support 
effective implementation in solving large scale GTRSs. Several other methods have 
been proposed for solving large scale instances of GTRSs under different conditions, 
see [2], [13] and [17]. 

The SD condition developed above in Section 2.1 could find its immediate ap¬ 
plications in the GTRS. When the two matrices A and B are SD, the problem is 
equivalent to the following SOCP problem as showed in [2]: 

• c T T 

mm o y + e x 

s.t. a T y + p T x + < 0, 

<Vi, i = l,...,n, 

where 5, cc, e, /3 £ JR n , <5 = Diag(P T PP), a = Diag(P T AP), e = P T a, /3 = P T b and 
P is the congruent matrix that makes both P T AP and P T BP diagonal. As SOCP 
reformulation can be solved much faster than SDP reformulation, it becomes possible 
to solve large scale GTRSs using SOCP reformulation when a problem is identified 
to be SD. Algorithm 1 actually enables us to verify whether a given instance of the 
GTRS is equivalent to its SOCP relaxation. Note that if the inequality in the GTRS 
becomes equality, the above analysis still holds true, see [2]. 

Problem (TRS) is always SD, as the Jordan normal form of I~ 1 B = B is a 
diagonal matrix (due to that the Jordan normal form of the symmetric matrix B is 
diagonal). Thus, problem (TRS) is always equivalent to its SOCP relaxation. 

When B — A A >- 0 holds for some A £ JR, this instance of (GTRS) is classified 
as a regular case [17]. It is clear that all regular cases are SD, since A and B under 
the above regularity condition are SD as discussed in Section 1. We thus claim that 
any regular case of the GTRS has an equivalent SOCP relaxation. We can further 
conclude that the applicability of the SD approach is wider than the existing methods 
based on regularity conditions. 
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SD condition can also be applied to solve the following interval bounded GTRS: 
(IGTRS) min —x T Bx + a T x 


s.t. I < —x T Ax + c T x < u, 


where lower and upper bounds l and u £ 5ft are chosen such that —oo < l < u < +oo. 
For regular cases of (IGTRS), [14] extends the results in [17] to the interval bounded 
GTRS. Adopting Algorithm 1 developed in this paper to identify whether a given 
instance of (IGTRS) is SD, we can verify whether the problem can be reduced to 
an SOCP problem based on the the results in [2] for QCQP with two quadratic 
constraints, which will be discussed in Section 4. We emphasize that the regularity 
condition implies SD. Thus, the applicability of our approach is wider than the results 
in [14], 


3. Simultaneous diagonalization for finite number of matrices. We now 

develop a method of checking simultaneous diagonalization for m symmetric matrices 
A 1 ,A 2 ,..., A m , which have a semi-definite matrix pencil, i.e., there exists A € 5ft™ 
with A / 0, such that AiAi + A 2 A 2 + • ■ ■ + A m A m y 0. Note that this condition 
is always assumed in the SDP relaxation for a QCQP problem; Otherwise the SDP 
relaxation is unbounded from below, see [9, 18]. 

It is well known from [7] that, if two matrices A and B commute, they are SD. It 
is interesting to extend this sufficient condition to a necessary and sufficient condition. 
The results in the following lemma have been mentioned in [2]. We provide its detailed 
proof in the following, which will be used to prove its extension, Theorem 3.2. 

Lemma 3.1. Suppose that A and B are two symmetric n x n matrices, and I 
is the n x n identity matrix. Then A, B and I are SD via an orthogonal congruent 
matrix if and only if A and B commute. 

Proof. “=>” part: If A, B and I are SD, then there exists a nonsingular matrix 
P such that P T AP, P T BP and P T IP are diagonal. Since P T IP is positive definite 
and diagonal, so there exists a diagonal matrix Q such that Q T P T IPQ = I. Let 
U = PQ, then U T AU, U T BU and U T IU are all diagonal and U T IU = I. So U is an 
orthogonal matrix. Furthermore, U T AU and U T BU are diagonal => U T AUU T BU = 
U T BUU T AU =>■ AB = BA, i.e., A and B commute. 

“<*=” part: Let P be the spectral decomposition matrix for A such that P T P = J 
and P T AP is diagonal. If A and B commute, i.e., AB = BA, then by PP T = 
I we obtain P T APP T BP = P T BPP T AP. We can always assume P to be a 
nonsingular matrix such that P T AP = diag(Ai/ ni , A 2 / ra2 ,..., Afc/ nfc ), where k < 
n, ilk is the algebraic multiplicity of A j. So, P T APP T BP = P T BPP T AP =>• 
P t BP = diag(Ri, B 2 , ■ ■ ■ ,Bk) is a block diagonal matrix and dim(Bi) = dim(/ rai ), 
VI < i < k. Using the spectral decomposition to all Bi, we obtain k diagonal matri¬ 
ces QfBiQi, where QfQi = I ni , and dim(Qi) = dim(/ rii ), VI < i < k. By denoting 
Q = diag(Qi, Q 2 ,..., Qk), Q T P T BPQ and Q T P T APQ are both diagonal matrices. 
Besides, Q T P T IPQ = I. Thus, A, B and I are SD. □ 

One by-product of Lemma 3.1 is its applicability in solving the following CDT 
problem [3]: 


min —x t Bx + a T x 
s.t. || x || 2 < 1 . 


|| A T x + c || 2 < 1. 
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Note that we can view the matrix in the quadratic term of the first inequality in the 
above CDT problem as I. We can then use Lemma 3.1 to identify if the three matrices 
are SD, i.e., if B and AA T commute. If so, we can then apply the method in [2] to 
solve the problem if one of the KKT multipliers is 0. 

The following theorem shows the SD condition for the identity matrix / and other 
to symmetric matrices when the congruent matrix is orthogonal, which is a classical 
result in linear algebra, see [7]. For the sake of completeness, we give a brief proof 
here. 

Theorem 3.2. Matrices I, A±, A 2 ,..., A m are SD if and only if Ai commutes 
with Aj, Mi,j = 1,2,..., m, i ^ j. 

Proof. Note that I,A\,A 2 ,..., A m are SD if and only if there exists a matrix P 
such that P T P = J, and P T AiP , • ■ ■, P T A m P are all diagonal matrices. Thus, P is 
orthogonal. 

We first prove the “=>” part. Since there is an orthogonal matrix P, which 
makes P T AiP , i = 1,..., to, all diagonal, P T AiPP T AjP = P T AjPP T AiP. So 
P T AiAjP = P T Aj AiP , and, thus, AjAj = AjAi, i,j = l,...,m,i^ j. 

Next we prove the part. As the case where m = 2 has already been proved in 
Lemma 3.1, we will use the induction principle to prove the general case. Suppose that 
Q^AiQi is the spectral decomposition of A\ such that Q\Q\ = / and QjAiQi = 
diag(Ai/ ni , A 2 / n2 , • ■ ■, A fe / n J, with 1 < k < n and A t ^ A j, if ijfij, 1 < i,j < k. Then, 
A\Ai = AiA\ QTAiQiQf AiQi = Qf AjQiQf A 1 Q 1 =>■ Ai := Qj^AjQi is a block 
diagonal matrix in the form of diag (Ai lt Ai 2 , ■■■,Ai k ), with dim(Ai ; ) = dim(/ ni ), 
i = l,..., to, l = 1, 2,..., k. Furthermore, 

Aj.Aj = AjAi Q^AiQiQ^AjQi = Qj’AjQiQf AiQ\. 

So A^ commutes with Aj ,, V2 < i, j < to, l = 1, 2, ■ • •, k. Now for every l = 1, 2, ■ • •, k, 
the case reduces to prove if to — 1 matrices Aj, , 2 < i < to, commute with each other, 
then they are SD by some orthogonal matrix P;. Note that the congruent matrix, 
R = diag (Pi,..., Pfc) has the same block structure as Aj. According to the induction 
principle and Lemma 3.1, which represents the case m = 2, we complete the proof. □ 

Theorem 3.2 also gives a recursion procedure to identify if /, A\, A 2 ,..., A m are 
SD. 

By applying Theorem 3.2, we have the following theorem. 

Theorem 3.3. If there exists A £ such that A 1 A 1 + A 2 A 2 + • —b A m A m >- 0, 
where, without loss of generality, X m is assumed not to be zero, then A±, A 2 ,..., A m 
are SD if and only if P T AjP commute with P T AjP, \/i ^ j, 1 < i, j < to — 1, where 
P is any nonsingular matrix that makes P T (XiAi + X 2 A 2 + • • • + A m A m )P = I. 

Proof. The matrix Ai^ + A 2 A 2 + • • • + A m A m is positive definite and thus there 
exists an orthogonal matrix U such that D = U T (X\Ai + X 2 A 2 + • • • + X m A m )U is 

1 ill 1 _ 

a diagonal matrix. Denote D* = diag(Pi 1 , Df 2 ,..., Df n ), and then D^U T {X\A\ + 
X 2 A 2 T * • • + X m ArrfjUD 2 — Note that A \,..., A m _i, Ai A\ + A 2 A 2 + ■ • • + A m A m are 
SD if and only if P T A\P ,..., P T A m -iP, P T {X\A\ + A 2 A 2 + • • • + A mA m )P are SD, 
and from Theorem 3.2, we conclude that P T A\P ,..., P T A m -\P, P T {X\A\ + X 2 A 2 + 
• • ■ + X m A m )P are SD if and only if P T AjP commutes with P T AjP, Mi ^ j, 1 < i, j < 

to — 1, where P = UD~z and P T (X\A\ + A 2 A 2 H-b A m A m )P = I. So we only need 

to prove that Ai, A 2 , • • •, A m are SD A\,A 2 ,..., A m _i, AiAi + A 2 A 2 H-b X m A m 

are SD. 

We first prove the part: If A\,A 2 ,..., A m are SD, then there exist a nonsin¬ 
gular matrix P such that P T A\P, P T A 2 P, ..., P T A m P are all diagonal matrices. 


RUJUN JIANG AND DUAN LI 


11 


Thus, A iP T AiP + X 2 P T A 2 P + • • • + A m P T A m P is a diagonal matrix. We therefore 
obtain that A\, A 2 ,..., A m _i , Ai A\ T A 2 A 2 ~\~ ■ * ■ T A m A m are SD. 

We prove next the “■$=” part: If A±, A 2 ,..., A m _i, A 1 A 1 + X 2 A 2 + • • • + A mA m 
are SD, then there exists a nonsingular matrix P such that P T A±P, P T A 2 P, ..., 
P T A m -iP, P T (XiAi + X 2 A 2 + • • • + X m A m )P are all diagonal. Since X m is not zero, 

P T A m P = [P t (XiA 1 +X 2 A 2 -\ - \-X m A m )PXiP T AiPj/Xm is also diagonal. 

□ 

For the semi-definite matrix pencil case, we have the following results. 

Theorem 3.4. Suppose that Ai, A 2 ,..., A m and B are nxn symmetric matrices 
with the following forms, 

Ai := (( 4 r a? ) > and b ~ ( Ip 0 ) ’ 


where dim A* = dim I p = p < n, A? is diagonal, VI < i < m, and A\ is nonsingular. 
Then Ai, A 2 ,..., A m and B are SD if and only if the following two conditions are 
satisfied: 

1. A 2 = Af(Af) _1 Af ; i = 2,...,m. 

2. A] — A 2 (A\)~ 1 (A\) T , i = 1,... , 171 , mutually commute. 

Proof. The “=>” part: If Ai, A 2 ,..., A m and B are SD, there exists a nonsingular 
matrix P such that P T A\P,P T A 2 P,... ,P T A m P and P T BP are all diagonal, and 
we can assume, without loss of generality, P T BP = B. As P T BP = B if and only if 


( Pi Ps \( I P \( Pi P*\_( Pi Pi PIP 2 
V PI PI J V 0 J(p 3 p 4 ) ^ p 2 P\ p 2 t p 2 


ip 


0 


we conclude Pi is orthogonal and P 2 = 0 . 
Furthermore, we have 


p t a 1 p 



Aj A* Pr P 2 \ 

AW Af )\P3 Pa ) 


Pi A] Pi 


PlA*P 3 

PJAIYPa + pJa\p 3 


Pi AP 3 A Pi AW Pi 


PiAjPi + pT A 3p 4 \ 
P T a AW ) ' 


Since P T AiP, i = 1 are diagonal, Pj (A 2 ) T Pi + PjA^P 3 = 0 holds 

true for i = 1,... ,m. As P 4 is nonsingular, we have (A 2 ) T Pi + AfP 3 = 0 for * = 
l,...,m. Solving (A^) T Pi + A\ P 3 = 0 yields P 3 = — (Af ) _ 1 (Ai) T Pi. Substituting 
P 3 = — (Af) _1 (Af ) t Pl into (Af ) T Pi + AfP 3 = 0 and by the nonsingularity of Pi, we 
further have Af (Af)" 1 ^) 7, = (Af) T , i = 2,... ,m. 

Substituting P 3 = — (Af) _ 1 (Af) T Pi into the (l,l)th block of P T AiP, PiA\P\ + 
PlAlP 3 + Pi A jP 3 + Pi (AW p i gives rise to Pl(A\ - Af (Af ^(Af ) T )Pi when i 
= 1 , and 


Pi {A] + Al(A\WA*(A\W(AW ~ A*(A\)~\AW 
= Pl{A\-A*(A\)-\AW)Pi, 


A\(A\)-\AW)Pi 


for i = 2,... ,m. Since the (l,l)th blocks of P T A^P, i = 1... ,m, and B are all 
diagonal matrices and Pi is orthogonal, we conclude that Aj — Af (Af) _1 (Af ) T , i = 
1,2,... ,m, mutually commute. 
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The “<S=” part: If conditions 1 and 2 hold, then P T AiP, i = 1..., m, and P T BP 
are all diagonal by choosing 

P= {-(Al)~\Ai) T Pl In- P )’ 

where Pi is the orthogonal matrix such that P-[ (Af — Af(Af )~ 1 {A\) T )Pi, i = 1,... ,m, 
are all diagonal. Note that the existence of Pi is due to condition 2 and Theorem 3.2. 

□ 

Now we extend the result in Theorem 3.4, in which A 1 A + A 2 A +■ ■ --|-A m A m >~ 0 
holds true, to situations where only the following assumption holds. 

Assumption 3.1. For m symmetric n x n matrices, A±, A 2 ,..., A m , there exists 
A G and A ^ 0, such that XiAi + A 2 A + • ■ • + X m A m y 0, but there does not 
exist A G R m such that X 1 A 1 + X 2 A 2 + ■ • • + A m A m >- 0. Without loss of generality, 
we assume X m ^ 0. 

For a given set of A,, i = 1, ..., m, we can always use an SDP formulation to 
verify whether there exist A ^ 0, which satisfies Assumption 3.1. If the following SDP 
is feasible, then there exists such aA/0 because otherwise trlf^f^XiAf) = 0, 

min 0 

m 

s.t. ^2 A A: h 0 , 

2=1 

m 

tr( A iAf) > 1. 

i=l 

When Assumption 3.1 holds, we can find a nonsingular matrix Qi and the corre¬ 
sponding A G such that A rn := Qj (AiA + X 2 A 2 -b X m A m )Qi = 

and 

(3.1) A := QTA;Q-i = ( ( jf 2 y J ) , * = l,2 ,...,m-l, 

where dim A\ = dim I p = p < n. 

Furthermore, if all Af , i = 1, .. m, are SD, then, by rearranging the common 
0s to the lower right corner of the matrix, there exists a nonsingular matrix Q 2 := 
diag(/p,IA) such that 

(3.2) A m ,= QlA m Q 2 = ( Ip Q 
and 

/ A\ Af Af \ 

(3.3) Aj := Q 2 AiQ 2 = | (Af) T A? 0 , 

V (A^) r 0 0 J 

where A) = A], Af,i = 1, 2 ,..., m — 1, are all diagonal matrices and do not have 
common 0s in the same positions. 

For any diagonal matrices D and E, denote supp(D) := {i \ Da ^ 0} and 
supp(-D) U supp(-E) := {* Da ^ 0 or Eu ^ 0}. 
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Lemma 3.5. For k {k > 2) n x n nonzero diagonal matrices D 1 , D 2 ,..., D k , if 
there exists no common Os in the same position, then the following procedure will find 
Pi G Si, * = 1,..., k such that piD 1 is nonsingular: 

Step 1. Let D = D 1 , pi = 1, and pi = 0, for i = 2,3,..., n, j = 1; 

Step 2. Let D* = D + pj+iD^ 1 , where Pj+i = {0,1,... , n} with s being 

chosen such that D* = D + pj+iD^ 1 and supp(D*) = supp(£>) U supp(H- J+1 ); 

Step 3. Let D = D*, j=j+l; if D is nonsingular or j = n, STOP and output D; 
Else, go to Step 2. 

Proof. We only need to prove that in Step 2 we can find a suitable s. The 
cardinality of supp^l" 1 " 1 ) is at most n and that of supp(U) is at most n — 1 (or we 
have already found a nonsingular matrix D). So if supp(H' J+1 ) = supp(D), let s = 0, 
and we have supp(D*) = supp(U) U supp(I? J+1 ). Otherwise, for any i G supp(D J+1 ), 
varying s from 0 to n will generate n + 1 different values for Du + —D^f, and at 
most one s can lead Du + ^Df^ 1 = 0. But as the cardinality of supp(I? J+1 ) < n , we 
can always find an s such that Du + PiDLf ^ 0 for all i G supp(D) U supp(LF +1 ). 

One way to find such an s is to test s from 0 to n to find out the value of s such that 

supp(D + ^Z? J+1 ) = supp(D) U supp(Z> J+1 ). □ 

Denote 


(3.4) 


m —1 

D = ^ ^ 

i=l 


Di D2 D4 \ 

(D 2 ) T d 3 0 I , 

(D 4 ) T 0 0 ) 


where pt, i = 1,2,..., m — 1, are chosen, via the procedure in Lemma 3.5, such that 
D 3 is nonsingular. Then we have the following theorem for a semi-definite matrix 
pencil. 

Theorem 3.6. Under Assumption 3.1, A±, A 2 ,..., A m are SD o A\, A 2 ,..., 
A m -1 and A m := A 1 A 1 + A 2 A 2 + • • • + A m A m y 0 are SD A f (defined in (3.1)), 

i = 1,2,..., m, are SD, and the following conditions are also satisfied: 

1. Aj = 0, i = 1, 2,... ,m — 1, 

2. A 2 =D 2 Df 1 Af, * = 1,2,... ,rn — 1, 

3. A) - AfD^Dl i = 1,2,... ,m — 1, mutually commute, where A), A 2 , A) and 
A) are defined in (3.3), and D is defined in (3.f). 

Proof. The first “<S=>” can be proved by the same technique with the proof for 
Theorem 3.3. 

We next prove the second “<*=>”. 

The “=>” part: A 1; A 2 ,..., A m _ 1 and A m are SD => A\, A 2 , ■ ■ ■, A m are SD (note 
that A m = QiA-mQ 1 by definition). From (3.1), (3.2) and (3.3), we know that there 
exists a nonsingular matrix Q 2 such that Q 2 AiQ 2 ,i = 1,2 ,... ,m, are SD and have 
the form in (3.2) and (3.3), i.e., 


Am : — Q2 AmQ2 — 


and 


A, :— Q 2 AiQ2 


M A? Af \ 

(A?) T Af 0 . 

(Af) T 0 0 j 


Since Ai and A m are SD, i = l,2,...,m — 1 A; and A m are SD, i = 
1,2, ..., m — 1 -<=> D, A;, i = 2,3,..., m — 1, and A m are SD. From Theorem 2.6 we 
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know D 4 = 0, Af = 0, i = 2,3,..., nn — 1, so Af = 0, i = 1,2,..., m — 1. Then from 
the proof in Theorem 3.4, we can conclude that conditions 2 and 3 are also satisfied. 

The “<=” part: Note that QfAiQi = Ai , i = 1,... ,m — 1. Then if A 3 are SD, 
i = 1,2,..., m, there exists a nonsingular matrix Q 2 such that (3.2) and (3.3) holds. 
Further denote 

/ Pi 0 0 \ 

(3.5) P := -(D 3 )- 1 (D 2 ) t P 1 I q 0 , 

V 0 0 In-p-q ) 


where P\ is the orthogonal matrix such that P'1 (A) — A^(D 3 ) 1 (D 2 ) t )Pi, i = 
1,..., m — 1, are all diagonal, and q = dim(A'(). Then one can check that 


p t a z p 

/ pT(Al-A^I)T-r> 2 -D^(A>y 
+T> 2 T>3 1 A 3 i T)z 1 DT)P 1 

((A?) T - A3D 3 - 1 DDPi 

V o 

Pf(AJ - A?D 3 - 1 DDPi 


P ] T (A2-D 2 D 3 - ] Af) 0 

A? 0 

0 In—p—q ) 


In—p—q 

i = 1.. .,m, are all diagonal. Thus, A 3 , A 2 ,..., A m _i and A m := AiAi + A 2 A 2 H-h 

A mAm >z 0 are SD via the congruent matrix Q\Q 2 P. □ 

Although we choose fi following the procedure in Lemma 3.5, the proof shows 
that Theorem 3.6 always holds for every p, such that D 3 is nonsingular. Based on the 
above discussion, we develop a systematic procedure in Algorithm 2 to verify whether 
the given m matrices are SD. 

Example 2 The following example shows a case in which three matrices do not 


mutually commute, but they are SD. Consider A = 


2 

20 


B = 


and C = 


3 6 

6 -20 


It is easy to check that AB ^ BA. Let U = 
Then, we can show that A, B and C are SD, as U T AU = 

, and U T CU = 


1 0 
0 1 


-1 -2 
-2 -28 
1 -0.5 

0 0.25 

U T BU = 


-1 0 
0 -1.5 


3 0 

0 -2 


4. Applications to quadratically constrained quadratic programming. 

Consider the following QCQP problem: 


(QP) min f°(x) 

s.t. f l (x) < 0, i = 1 ,..., m, 

where f°{x) = \x T A 0 x + a^x, and f l {x) = \x T AiX + afx + \di , A 0 ,Aj £ S n , 
ao,ai £ 5R" and di £ 5ft, * = 1 ,..., m. 

Let us consider first the homogeneous case where a* = 0, i = 0,l,...,m. If 
A 0 , Ai,..., A m are SD with Ai being the diagonalized matrix of A it then (QP) is 
equivalent to the following problem: 


11 i 

(HQPSD) min^ -Diag(A 0 )k^k 

k—l 
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Algorithm 2 Procedure to check whether m matrices are SD 

Input: m symmetric matrices A\, A 2 , ■ ■ ■ ,A m , which satisfy that 3A £ 5ft m , A / 0, 
such that Xi.Ai A 0 

1: Find a nonsingular matrix Q 1 such that A m = Qf (\iAi+\ 2 A 2 +- • ■+X m A m )Qi = 
{ p q V in which we assume A m 7^ 0, otherwise we can exchange the index 


m with k for some A k 7^ 0; Define Ai = Q^AiQi 
1 , 2 ,..., to — 1 


Aj A? 

(Af) T 


i = 


2: if Al i= 1,2 ,... , m — 1, are not SD then 
3: return “not SD” 

4: else 

5: Find a congruent matrix V that makes all Af diagonal 1 , and Q 2 = diag(/ p , V) 

( A 1 A? Af \ 

that makes Q^QfAiQiQ2 = I (Af) T A? 0 1, i = 1,..., m — 1 

V (At) T 0 0 y 

6: Find Hi, i = 1, 2,..., m — 1, via the procedure in Lemma 3.5, such that D3 := 

AL-Af is nonsingular, and denote D2 := i. 1 Mi A? 

7: if i) Af = 0, i = 1,2,..., m — 1, ii) Af = D 2 D 3 -1 Af, i = 2,..., m — 1, and iii) 

A 1 — Af D 3 " 1 D^, i = 2,..., m — 1, mutually commute then 
8 : return U T AiU, i = 1 ,..., m, and 17 = Q 1 Q 2 P , where P is defined in (3.5) 

9: else 

10: return “not SD” 

11: end if 

12: end if 


n 1 _ l 

s.t. Y 9 Dia g(A*)fc£fc + -di < 0, i = 1 ,..., 1 


fc=l 


In fact, (HQPSD) is equivalent to the following linear programming problem 
formulation: 


min E -Diag(A 0 ) fc y fc 

fc=1 

n 1 - 1 

s-t. ^ -Diag(A, ; ) fc ?/ fc + -di < 0, i = 1,..., to, 

fc=l ^ 

yk > 0, 

which can be solved efficiently by several methods in the literature, e.g., the simplex 
algorithm. 

Introducing x n +i = ±1 in nonhomogeneous (QP) gives rise to the following equiv¬ 
alent problem formulation: 

(QP') min -x T Aox + a^xx n +\ 

1 In the algorithm, we always rearrange the common 0s to the lower right corner of the V T Af V\ 
i = 1, ..., m — 1, via the congruent matrix V, and use a recursion to find the congruent matrix V 
that makes all Af diagonal. 
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s.t. i x T AiX + afxx n+ i + ^diX ^ +1 <0, i = 


L n +1 


= 1 . 


Denote Bi = 


Ai cii 

af di 

We can rewrite (QP') as the following homogeneous problem: 


, i = 0,1,..., m (here do = 0), and B m+ 1 = 


1 T 71 

nun —x BqX 


s.t. —x 1 BiX <0, i = 1,..., m, 
x T B m+1 x = 1. 


We can then apply Algorithm 2 to check the SD condition of the above problem. In an 
SD situation, a nonhomogeneous QCQP problem can be also reduced to an equivalent 
linear programming formulation, similar to the homogeneous case. 

Furthermore, when to = 1 or 2, the above problem has exact relaxations in some 
cases as showed below. 

For to = 1, it is the GTRS, which possesses an exact relaxation when SD condition 
holds as we discussed in (TRS) and (GTRS) in Section 2.2. 

For m = 2, we have the following SOCP relaxation when the three matrices are 
SD: 


(QP 2 — SOCP) min 5 T y + e T x 

s.t. a T y + /3 t x < ^di, 

r] T y + e T x < id 2 , 

<yi, i = 1 ,..., n, 

where 5 , e, a, /3, ?y, 9 £ 5ft”, <5 = Diag(P T A 0 P), a = Diag(P T AiP), rj = Diag(P T A 2 P), 
e = P T ao, /3 = P T ai, 9 = P T a 2 and P is the congruent matrix that makes P T AiP , 
* = 0,1, 2, all diagonal. Ben-Tal and Hertog [2] demonstrate that if one of the KKT 
multipliers of the first two constraints in (QP 2 —SOCP) is 0, then the SOCP relaxation 
is exact. For the SOCP relaxation of problem (IGTRS), the two quadratic constraints 
are relaxed to 


a T y + [3 T x < u, 

— a T y — /3 t x < —l, 

and one of the KKT multipliers must be 0, as the two boundary conditions cannot 
be binding simultaneously, i.e., it can not be l = a T y + fd T x = it, thus, satisfying 
Assumption 6 in [2] automatically. 

5. Conclusion. In this paper, we have succeeded in providing complete answers 
to the open question on simultaneous diagonalization (SD) posted in [6]. More specif¬ 
ically, we have identified a necessary and sufficient SD condition for any two real 
symmetric matrices and a necessary and sufficient SD condition for multiple (more 
than two) real symmetric matrices under the existence assumption of a semi-definite 
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matrix pencil. Furthermore, we have demonstrated how SD can be utilized as a pow¬ 
erful instrument to verify the exactness of the SOCP relaxation of QCQP, especially 
with one or two quadratic constraints, and to facilitate the solution process. One of 
our future work is to find a necessary and sufficient SD condition for multiple matri¬ 
ces without the assumption of semi-definite matrix pencil and find more real-world 
applications of our SD procedure. 


Appendix. Derivation of the congruent matrix for Example 1. In this 
appendix, we show how to derive the congruent matrix P for Example 1 by applying 
Algorithm 1: First note that A is already in the form of diag(Ai,0) and thus we 


do not need to goto Line 1. Denote Ai := 


1 

0 

0 \ 

/ 1 

2 

0 \ 

0 

4 

0 

, Si := 2 

5 

1 

0 

0 

9 / 

V 0 

1 

7 / 


/ 0 

3 

0 \ 

f 2 

2 

0 

B 2 := 0 

0 

0 , and B 3 := 

2 

5 

0 

\ 0 

0 

0 / 

^ 0 

0 

0 


Next we goto Line 2. Applying the 


spectral decomposition to B 3 yields 


/ 6 

0 

0 \ 

/ 

' -0.4472 

-0.8944 

0 \ 

0 

1 

0 

, where Vi := 

-0.8944 

0.4472 

° 

V 0 

0 

0 / 

\ 

, 0 

0 

1 / 


Letting Q 2 := diag(/3, V\) gives rise to Line 3. 

Si 


B := Qi BQ 2 



/ -2.6833 1.3416 

where B 4 := I 0 0 | and B 6 := 

\ 0 0 

A and B are SD and we skip Lines 4-6. Following Line 7, letting 


6 0 
0 1 


. Note that since B 5 = 0, 


Qs := 




( 1 0 0 0 0 0 \ 

0 1 0 0 0 0 

0 0 1 0 0 0 

0.4472 0 0 1 0 0 

-1.3416 0 0 0 1 0 

0 0 0 0 0 1 / 


B ■= Q 3 BQ 3 


B\ — B \ B 6 1 B 


Bl 


Br, 


Be, 


2 0 0 0 0 \ 

5 10 0 0 
1 7 0 0 0 

0 0 6 0 0 

0 0 0 1 0 

0 0 0 0 0 / 


further yields 
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Then we goto Line 8. With 


/ —2 2 0 \ / 1 0 0 \ 

B 1 - B A B^Bl = 2 5 1 , Ai = 0 4 0 , 

\o 17/ y o o 9 y 

we obtain 

/ -2 2 0 \ 

Aj(B 1 -B A BpBj)= i 0.5 1.25 0.25 . 

\ 0 0.1111 0.7778 ) 

Applying Jordan decomposition gives rise to J := V 2 1 A^ l (B\ — B 4 B^ 1 Bj ) V 2 = 
diag(1.5657, -2.2837,0.7458), where 

/ 3.98 194.23 -0.21 \ 

V 2 := 7.09 -27.55 -0.29 . 

V 1 1 1 / 

Thus, Ai and B\ — B^Bq 1 BJ are SD, and with V 2 A\V 2 = diag(226,40772, 9) and 
V 2 (Bi — B^Bq 1 Bj)V 2 = diag(354, —93111, 7). Next we go to Line 9. Denote 

\ 


1 / 

Note that in the last step, V 2 A\V 2 is already diagonal, so we do not need to ap¬ 
ply spectral decomposition to V 2 A\V 2 . Now by letting the congruent matrix P := 
Q2Q3Q4, we have 


Qi := diag(V r 2 ,/ 3 ) = 


( 3.98 194.23 -0.21 

7.09 -27.55 -0.29 
111 


P t AP = diag(226,40772,9,0,0,0), 


and 


P t BP = diag(354, -93111,7,6,1,0). 
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